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(S) Video image processing apparatus. 

® calLyn?%''^f .S!^^^^ apparatus, an analogue video Image is converted to a binary value by 
calculating (5. 6) threshold values of respective neurons and coupling coefficients of resoective 

SS^inlH%"!^'^^ x^ilT'*' °" ^^'^ input analcS^Te Jid^ imagT and I 

predetemiined function. This can be done by anranging that a difference component E beWve^n the 
input analogue video image and the binary value Image ^ defined as : ^'""P""^"^ t oetween the 

E = (-i) E E p^^^ p^^ y^.^ , a 11%,, p^,, . c 
* J i 

TrUnl^i^^^ coefficient, m^i) « the value which results from converting the input analogue video image 
into me binary va ue, P<,,^ is the value obtained from the function, and g^n is the value obtained l^mthl 
ftincbon and the input analogue vWeo image. The functfon is preferably a frequenoT ch^SnSc^^^ 
human's eyes. The input analogue video in«ge may be a computer hcJogran? and then m^^^ 

IS^it.^f^;n"1?r '"il*^^ ^ ^^"96 of a desired video image in a ijJciucid i^^^^^ 

results from Founer-transfonning the computer hologram. .inaye wnicn 
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This invention relates to video image processing apparatus. 

When an analogue video image is converted to a binary value, the number of picture elements (pixels) 
which fonn the analogue video image are increased, for example, to twice the number of pixels in the vertical 
and horizontal directions, so that each pixel is now expressed by four small pixels. As a result, five gradations 
are possible for each set of four small pixels, that is, the four snnall pixels are either all white, one pixel is black 
two pixels are black, three pixels are black, or all four pixels are black. The pixels of the analogue video image 
are compared with four threshold values and converted to respective expressions of the five gradations in res- 
ponse to the compared outputs. 

If conversion or quantization is simply perfonmed as described above, the gradation of the video Image 
changes in a step-wise nrwnner thereby producing a so-called quaskxjntour. and resulting in considerable deg- 
radation of the quality of the vkieo image. 

As a result, a prior proposal has been made to remove the quasi-contour by mixing the analogue video 
image with a desired noise component having no correlation to the analogue video image. However, this method 
results in a lower signal-to-noise (S/N) ratio of the video image, so that a good image quality is not obtained 

Moreover, when a so^lled computer hologram is fomned. it is supplied in binary form although it is fomied 
from an analogue value. As a result, quantization noise occurs whfch causes the S/N ratio of a reproduced pic- 
ture to be considerably deteriorated. 

According to the present invention there is provided a video image processing apparatus for converting an 
analogue video image into a binary video image, the apparatus comprising: 
20 input means for receiving said analogue vkleo image; 

sampling means for sampling the received analogue vkieo image; 

a neural network circuit having a plurality of neurons which are connected together through respective synap- 
ses^ 

setting means for setting a predetermined function; 

first computing means forcomputing respective threshold values for each of said neurons in said neural network 
circuit on the basis of the sampled value of the video image and said predetermined (unction; and second conv 
putmg means for computing respective coupling coefndents for each of said synapses of said neural network 
circuit on the basis of said predetermined function; 

said neural network circuit processing said threshold values and said coupling coefncients so as to form said 
30 binary video image. 

The invention will now be described by way of example with reference to the accompanying drawings 
throughout which like parts are referred to by like references, and in which: 

Figure 1 is a bkjck diagram of an embodiment of video image processing apparatus according to the present 
invention; 

35 Figure 2A is a schematic diagram showing an example of a Hopfield type neural network circuit; 

Figure 2B is a schematic diagram showing an arrangement of neurons; 
Figure 3 is a diagram for explaining a neural nehMOik circuit: 

Figure 4 is a diagram showing an example of a binary video image derived by a prior method 
Figure 5 is a diagram showing an example of a binary vMeo image derived by a video image' processing 
■« apparatajs according to the present invention; 

Figure 6A is a diagram showing a prior example of a reproduced picture of a computer hologram and 
Figure 6B is a diagram showing an example of a reproduced picture of a computer hologram using an embo- 
diment of the present invention. 

Referring to Figure 1 . an analogue video image signal is supplied through an analogue video image input 
device 1 to a sampling device 2. in which it is sampled horizontally and vertically in a manner similar to that 
used in television scanning, to extract values of respective pixels. 

A neural network circuit 3. for example, a Hopfield type neural network circuit which will be more fully des- 
cribed below, is preferably provided with four times as many neurons as the number of sampled pixels corre- 
sponding to the small pixels in the previously described prior convereion. 

Also shown in Figure 1 is a fonction setting devfee 4 in whteh a predetermined function is set which, for 
example, has a binary frequency which corresponds to a frequency characteristic of a human's eyes The func- 
tion set in the function setting devtoe 4 and the values of respective pixels sampled by the sampling device 2 
are supplied to a computing device 5 which computes threshold values for respective neurons of the neural 
network circuit 3. The (unction set In the function setting device 4 is also supplied to a computing device 6 which 
55 computes coupling coe(Ttcients for synapses of the neural network circuit 3. 

Processing is perfomied in the neural networii circuit 3. and converged values formed in the respective 
neurons are supplied to an output device 7 as an output binary video image signal. 

Altemafivety. the value of each pixel sampled by the sampling device 2 may be compared with a desired 
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threshold value whereupon the compared output may be supplied to each neuron of the neural network circuit 
3 as an initial value. 

As a result, the input analogue video image from the input device 1 is converted to a binary value. 
More specifically, assume that a human's image focusing system is incoherent. A resultant image g^^, is 
provided by multiplying an original video image g^^j by a filter having a characteristic of a human's eyes, 
this being basically a low-pass filter characteristic. 

Substituting the Fourier-transform of Wp. which is represented as W(„), yields the following equation (1): 

9<m) = Q{m) * W(„, (1) 

where * represents the convolution. 

On the other hand, assume that m<„) represents a binary video image and aM<„„ represents the binary video 
image as focused on the retina of a human's eyes, in which n represents a coefndent selected by the video 
image, ix^^y may be expressed as: 

A<m) = m„,) "W^^) (2) 

An embodiment of the present invention converts an analogue video image into a binary value, so that the 
15 difference, as formed on the retina of a human's eyes, between the binary video Image and the original video 
image Is minimized. 

An error energy E may be defined as: 



10 



20 



25 



30 



35 



40 



45 



SO 



E » E I a a(., 1^ ...(3) 

m 

Substituting equation (2) into the equation (3) yields: 

m 

m m 

■ 

Further, assume that: 

i 

Substituting the above expression In equation (4) yields the following equation (5): 

• ■ 1 J 

- 2a E E ft^., w,..,, ...5 

■ J 

Further assuming that 



55 



4 

BNSDOCID: <EP 0467577A2 1 > 



20 



30 



35 



40 



45 



50 



55 



EP 0 467 577 A2 



10 



I 



-2 L w„.„ w,..,, If : i ,< j 



If : 1 = J 



t5 



ttien. substituting the above expressions into equation (5) produces the following expression for the en-or energy 
E = (-i) E E P{i. 4, ♦ a E t<„ M(o ♦ C ...(6) 



1 J 



25 The Hopfield type neural network circuit 3 may. for example, be constructed as shown in Figure 2A in which 
L"« "iTr ^ comparator, and synapses are fbmfied as resistors (see US patent specification US-A-4 

660 166 and US-A-4 719 591). In this situation if S,, is a threshold value of a neuron, V,„ is an output of the 
neural network circuit, and T,, j, is a coupling coefficient between respective neurons. The output V,,, mav be 
expressed as: ' 



V.i, 



♦ 1 if: E T(j. J, V,j, i S(„ 
J 



- 1 If : E T,i. V(,, < S(„ 



This circuit may be schematically represented as in Figure 2B. If. however. fJve neurons are provided, then the 
neural network circuit is constmcted as shown in Figure 3. 

If the coupling coefTicient of synapses which return to the same neuron is 0 and the coupling coefficients 
between the neurons are equal to each other, then the neural network circuit shown in Figure 3 operates so 
as to minimize the error energy E which, in turn, may be expressed as: 

E - (-i) E E p(,, T,i. „ M^,, ♦ E May ...(7) 
1 J 

Accordingly, as is to be appreciated from equations 6 and 7. if in the above-described apparahjs the 
tfireshold va ues S,„ of respective neurons in the neural netwoik circuit 3 are computed by the computinq device 
5 on Uie basis o the value g,„, sampled by the sampling device 2 and the function w,„, set in ^seTno deviS 
4. and the coupling coefjclents T, , of respective synapses of the neural networi. 'circuit 3 arVclputd S 

ttiecomputmgdevicee theanalofluevideoimageis converted intoabinary value Which hasarelativeT^^^^^^ 
error as observed on the retina of a human's eyes. >auveiy minimal 

In a preferred embodiment of the above described apparatus, the calculations required in the neural net- 
work circuit 3 are performed by a computer. 1= "OUfdl IltSl 

A^^'^'LT* ^ «''^'"P'«s of binary value video images in which an original picture having 

480 X 480 pixels .s converted into a binary video image having 960 x 960 pixels. More specifically FlgurH 
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shows an example of a binary video image produced in accordance with a prior method, whereas Figure 5 
shows a binary video image of excellent quality fomied by the apparatus of the present Invention. 
The formation of a computer hologram will now be described. 

In formulating a computer hologram, video image infonmation is Fourier-transformed and the Fourier- 
5 transformed analogue value is converted into a conresponding binary value, which is then recorded as a holog- 
ram. Accordingly, the video inwige Fourier-transformed represents a hologram spectrum. Therefore the com- 
puter hologram converts an analogue waveform Fourier-transfomied into a binary value in which the hologram 
spectrum represents a desired portion. However in the prior art, it is frequently observed that, ff an analogue 
video image is converted into a binary value by a simple slice level, quantization noise occurs which causes 
10 the S/N ratio to be deteriorated. 

Therefore, assume that Gqc) represents a signal on a spectrum surface, that is. a reproduced video image. 
Further, assume that an area from which noise is to be removed on the spectrum surface can be expressed 
by a window function W^^) which may, for example, be expressed as: 
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if noise is to be renoved froa the area 



if noise is pernitted in the area 



Further, assume that noise is to be removed from a portion in which the signal Gj^) is defined. That is: 

W(k, = 1 ifG(k,*0 (a) 
g(,„) represents the Fourier-transfomi of the signal G^k,, and since g<„, is typically a complex number, it cannot 
be recorded directly. Therefore, instead of g^^^, 

b(m)€{+1..1} 

IS recorded. As a result, a signal appearing on the spectmm surface becomes B(k). instead of the ideal signal 
G(kj, in which B(k) is the Fourier-transform of b(,„). 

In the present case the intention is to make b(„> such that the difference between B(k> and G{k, is minimized. 

Accordingly, the error eneigy E Is defined as follows: 

E = E I W,^, {G,^y - a Bj,,} |^ ...(b) 

k 



35 According to Parseval's theorem, the above-mentioned definition yields: 
■ 

40 

In this case, it is assumed that G(k, and W(k, satisfy a conjugate symmetric relationship relative to the original 
point. That is, 

G(ic) = GV) and W(,) = W^^) 
At that time. Fourier-transforms g(„,) and W(,„) become real numbers. 
45 Arranging the energy function E by the use of this relationship yields: 

E = (-i) E E bji, P(i, jj b^jj ♦ a E b^^, g^^, ♦ C • . . (d) 
i J t 

50 

where: 
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-2 E 



if : 1 I' j 



if : 1 - J 
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Accordingly, on the basis of equation (d) and equation (7) of the Hopfield type neural network circuit g,,, 
assumes a threshold value of each neuron. P^j, assumes a coupling coefficient of each synapse and'bl 
assumes an output of each neuron. As such, it is possible to minimize the enor energy E by using the neural 
network circuit 

Figures 6A and 6B illustrate actual examples of reproduced video images of computer hologram More 
specifically, Figure 6A shows a prior reproduced video image in which the S/N ratio is considerably deteriorated 
whereas as shown in Figure 6B. an excellent reproduced video image can be produced using an embodiment 
of video image processing apparatus according to the present invention, in which noise is reduced in the desired 
portion of the video image. 

As described above, with an embodiment of video image processing apparatus according to the^resent 
invention, a video image is processed by the use of the neural network circuit, whereby the analogue video 
25 image can be satisfactorily converted into a binary value and a computer hologram can be satisfactorily formed 
With the above-described video image processing apparatus, the threshold values of the respective 
neurons and the coupling coefficients of the respective synapses in the neural network circuit are computed 
on the basis of the incoming analogue video image and a predetemiined function as previously described 
The difference component E between the incoming analogue video image and the binary video image is 
30 defined as: ^ 

E - (-i) a' E E P(,. J, ♦ a E ^x^^^ * C 
i i 1 



where a represents the coefficient, n,, represents the value which results from converting the Incoming 
analogue video image into the binary value. P,^ „ represents the value which is obtained from the function, and 
g,,) IS the value which is obtained firom the function and the input analogue video image. As a result it is possible 
to convert the input analogue video image Into the binary value by using the neural networtt circuit 

Further, by setting the function to have the frequency characteristic as a human's eyes, it is then possible 
to obtain a binary video image which is visually excellent for a human's eyes. 

Further, if the incoming analogue vkJeo image is a computer hologram and the function is a window function 
which indicates the range of the desired image of the reproduced video image which in turn results from Fou- 
ner-transfonming the computer hologram, the noise in the range of the desired image in the reproduced video 
45 image can be reduced and an excellent reproduced video Image can be obtained 



Claims 

50 



I. A video image processing apparatus for converting an analogue video image into a binary video image 
the apparatus comprising: ** ' 

input means (1) for receiving sakl analogue video image; 
sampling means (2) for sampling the received analogue video image; 

a neural network circuit (3) having a plurality of neurons which are connected together through respective 
55 synapses; ^ 

setting means (4) for setting a predetennined function; 

first computing means (5) for computing respective threshold values for each of sa id neurons in said neural 
nehivork circuit (3) on the basis of the sampled value of the video image and said predetennined function 
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and 

second computing means (6) for computing respective coupling coefficients for each of said synapses of 
said neural networt^ circuit (3) on the basts of said predetermined function; 

said neural network crcuit (3) processing said threshold values and said coupling coefficients so as to 
form said binary video Image. 

Apparatus according to daim 1 wherein a difference component between the input analogue video image 
and said binary video image is a function of the value obtained firom said predetemiined function, and the 
value obtained from said input analogue video image and said predetermined function. 

Apparatus according to dalm 1 wherein said predetermined function has a frequency characteristic which 
corresponds to that of a human's eyes. 

Apparatus according to daim 1 wherein the input analogue video image is a computer hologram and said 
predetermined function is a window function indicative of a range of a desired image of a reproduced video 
image which results from Fourier-tFansfonming said computer hologram. 
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FIG. 4 
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F/G. 6A 




FIG. 6B 
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